"To watch the surfers" means to observe people who are riding or attempting to ride waves with a surfboard.